TITLE OF THE INVENTION 
MULT I PROJECT I ON SYSTEM AND METHOD OF ACQUIRING 
CORRECTION DATA IN MULT I PROJECT I ON SYSTEM 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This is a Continuation Application of PCT 
Application No. PCT/ JP03/06738 , filed May 29, 2003, 
which was not published under PCT Article 21(2) in 
English . 

This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Application No. 2002-160475, filed May 31, 2002, the 
entire contents of which are incorporated herein by 
reference . 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a multipro j ection 
system that provides display using images projected 
by a plurality of projectors as well as a method of 
acquiring correction data in the multipro j ection 
system. 

2. Description of the Related Art 

In a multipro j ection system^a plurality of 
projectors project images on a screen to obtain one 
image. Accordingly, measures must be taken to, for 
example, make the joints between the projected images 
unnoticeable . Thus, a calibration image is projected 
on the screen, and the projected image is captured 
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using capturing means such as a digital camera. Then, 
various corrections are executed on the basis of image 
data obtained by the capturing (for example, refer to 
Jpn. Pat. Appln. KOKAI Publication No. 2002-72359 and 
5 Jpn. Pat. Appln. KOKAI Publication No. 2002-116500). 

Even for a black level image in which R, G, and B 
signal levels are all zero, the projector outputs light 
having a specified luminance. Accordingly, the black 
level must be corrected (offset correction) . However, 

10 in the prior art, the calibration image is captured 

without separating R, G, and B colors from one another. 
Thus, if a dark image is displayed, the colors may be 
nonuniform within each projector or between the 
projectors. This degrades display quality. 

15 It is an object of the present invention to 

provide a multipro j ection system that can improve 
display quality by reducing the color nonuni f ormi ty 
within each projector or between projectors, as well 
as a method of acquiring correction data in the 

20 multipro j ection system. 

BRIEF SUMMARY OF THE INVENTION 
According to a first aspect of the present 
invention, there is provided a multipro j ection system 
that displays one color image by joining a plurality 

25 of color images projected by respective projectors. 

The system includes an image capturing section 
including an optical section having a plurality of 
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filter characteristics corresponding to a plurality 
of basic colors constituting the color image projected 
by the projectors, and capturing an image of each of 
the basic colors via the optical section; and 
5 a calculating section calculating offset correction 

data for each of the basic colors on the basis of 
a luminance distribution of offset light of each of 
the basic colors obtained by allowing the image 
capturing section to capture a black level image 
10 projected by the projectors. 

The present invention may include following 
embodiments . 

The multipro j ection system further includes 
a correcting section correcting an image signal input 
15 to the projector using the offset correction data 

calculated by the calculating section. 

Wavelength ranges of the filter characteristics do 
not overlap one another. 

The optical section has a plurality of filters 
20 corresponding to the plurality of filter character- 

istics, and the plurality of filters can be switched by 
a mechanical operation. 

The optical section has a tunable filter that 
can electrically set the plurality of filter 
25 characteristics . 

The calculating section calculates the offset 
correction data for each of the basic colors so that 
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an offset luminance level of each of the basic colors 
equals a maximum value of the luminance distribution 
of offset light of each of the basic colors all over 
a projection area of the plurality of projectors. 
5 The multipro j ection system further includes a 

section calculating a gamma characteristic distribution 
of each of the projectors on the basis of a luminance 
distribution of each image obtained by allowing the 
image capturing section to capture an image of each 
10 basic color at each signal level projected by the 

pro j ector . 

The optical section further has a filter 
characteristic that does not allow light of wavelength 
from 650 nm to a predetermined value to pass through. 

15 According to a second aspect of the present 

invention, there is provided a method of acquiring 
correction data in a multiproj ection system that 
displays one color image by joining a plurality of 
color images projected by respective projectors. The 

20 method includes: projecting a black level image from 

the projectors; separating the black level image into 
images of basic colors constituting the color image 
using an optical section having a plurality of filter 
characteristics corresponding to the basic colors; 

25 capturing each of the separated images of the basic 

colors; and calculating offset correction data for each 
of the basic colors on the basis of a luminance 



distribution of offset light of each of the basic 
colors obtained by capturing each of the separated 
images of the basic colors. 

In this method, calculating the offset correction 
data may include calculating a gamma characteristic 
distribution of the projector. 

Advantages of the invention will be set forth in 
the description which follows, and in part will be 
obvious from the description, or may be learned by 
practice of the invention. Advantages of the invention 
may be realized and obtained by means of the 
instrumentalities and combinations particularly pointed 
out hereinafter. 
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate embodiments of the invention, and together 
with the general description given above and the 
detailed description of the embodiments given below, 
serve to explain the principles of the invention. 

FIG. 1 is a block diagram showing the functional 
configuration of a multipro j ection system according to 
an embodiment of the present invention. 

FIG. 2 is a view illustrating the specific 
configuration of the multipro j ection system according 
to the embodiment of the present invention. 

FIG. 3 is a block diagram showing the details of 
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a part of the configuration of the mult ipro j ection 
system shown in FIG . 1. 

FIG. 4 is a view schematically showing an example 
of the calibration camera shown in FIG. 2. 
5 FIG. 5 is a view schematically showing another 

example of the calibration camera shown in FIG. 2. 

* FIG. 6 is a graph showing an example of the 
spectrum characteristics of projectors and filters in 
the multipro jection system according to the embodiment 
10 of the present invention. 

FIG. 7 is a graph showing the luminance 
distribution of offset light from the projectors 
according to the embodiment of the present invention. 

FIG. 8 is a graph showing the relationship between 
15 the luminance distribution of offset light and target 

offset luminance. 

FIG. 9 is a flow chart showing operations of the 
multipro j ection system according to the embodiment of 
the present invention. 
20 FIG. 10 is a graph showing another example of the 

spectrum characteristics of the projectors and filters 
in the multipro j ection system according to the 
embodiment of the present invention. 

FIG. 11 is a view schematically showing another 
25 example of the calibration camera shown in FIG. 2. 

DETAILED DESCRIPTION OF THE INVENTION 
An embodiment of the present invention will be 



described below with reference to the drawings. 

FIG. 1 is a block diagram showing the functional 
configuration of a mul t ipro j ection system according to 
an embodiment of the present invention. 

The basic configuration of the mult ipro j ection 
system according to the present embodiment is similar 
to that of a general mult ipro j ection system. The 
present multiproj ection system comprises a control 
section 11 that controls the whole system, an image 
display section 12 that displays images to be projected 
on a screen, a calibration pattern generating section 
13 that generates a calibration pattern (calibration 
image) , an image capturing section 14 that captures the 
calibration pattern projected on the screen by the 
image display section 12, an image correction data 
calculating section 15 that calculates various image 
correction data on the basis of the captured 
calibration pattern, and an image converting section 16 
that uses the calculated image correction data to 
correct input image data to generate output image data. 

FIG. 2 is a view illustrating the specific 
configuration of the mult ipro j ection system according 
to the embodiment of the present invention. 

A personal computer (PC) 21 has the functions of 
the control section 11, calibration pattern generating 
section 13, and image correction data calculating . 
section 15, shown in FIG. 1. The personal computer 21 
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controls the whole system and has a function of 
generating various calibration patterns and various 
arithmetic functions. An auxiliary apparatus 22 is 
connected to the personal computer 21. The auxiliary 
5 apparatus 22 has a part of the functions of the image 

converting section 16 and image display section 12, 
shown in FIG . 1 . 

Projectors 23a, 23b, and 23c correspond to the 
image display section 12, shown in FIG. 1. Images 

10 projected on an arch-type screen 24 by the projectors 

23a, 23b, and 23c are synthesized into one image on 
a screen 24 so that joints are created between the 
images (the images overlap one another) . In addition 
to normal images, the projectors 23a, 23b, and 23c 

15. project a calibration pattern on the screen 24 during 

calibration. In the example shown in the figure, the 
three projectors are arranged in a lateral direction. 
However, it is possible to change the number of 
projectors or the manner of arranging them. 

20 A camera 25 corresponds to the image capturing 

section 14, shown in FIG. 1. The camera 25 captures a 
calibration pattern projected on the screen 24 from the 
projectors 23a, 23b, and 23c. The camera 25 may be, 
for example, a digital camera. Image data obtained by 

25 capturing is transmitted to the personal computer 21, 

which then calculates various image correction data. 

FIG. 3 is a block diagram showing the details of 
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the image correction data calculating section 15 and 
image converting section 16, shown in FIG. 1. 

The image correction data calculating section 15 
comprises geometric correction data calculating section 
5 31 that calculates data required to correct the 

positional relationship between images projected by the 
projectors, matrix data calculating section 32 that 
calculates data required to correct the colors of the 
images projected by the projectors, a gain correction 

10 data calculating section 33 that calculates data 

required to correct the gains (luminance) distribution 
of the image area projected by the projectors, an 
offset correction data calculating section 34 that 
calculates data required to correct the black level 

15 (offset level) distribution of the image area projected 

by the projectors, and a gamma correction data 
calculating section 35 that calculates data required to 
correct the gamma characteristic distribution of the 
image area projected by the projectors. The image 

20 correction data calculating section 15 calculates each 

correction data on the basis of image data on an image 
captured by the image capturing section (calibration 
camera) 14. 

The image converting section 16 comprises a 
25 geometric correcting section 41, a matrix correcting 

section 42, a gain correcting section 43, an offset 
correcting section 44, and a gamma correcting section 



45. The image converting section 16 uses correction 
data calculated by the image correction data calculat- 
ing section 15 to execute correcting processes on input 
image data (an input image signal) . The image 
converting section 16 then outputs the corrected image 
data as output image data (an output image signal) . 

That is, corrected data calculated by the 
geometric correction data calculating section 31, the 
matrix data calculating section 32, the gain correction 
data calculating section 33, the offset correction data 
calculating section 34, and the gamma correction data 
calculating section 35 are transmitted to a geometric 
correction data storing section 41a, a matrix data 
storing section 42a, a gain correction data storing 
section 43a, an offset correction data storing section 
44a, and a gamma correction data storing section 45a, 
respectively. Then, using these correction data, the 
input image data is corrected by a geometric correction 
data processing section 41b, a matrix data processing 
section 42b, a gain correction data processing section 
43b, an offset correction data processing section 44b, 
and a gamma correction data processing section 45b. 

FIG. 4 is a view schematically showing an example 
of the calibration camera 25, shown in FIG. 2. 

The camera 25 comprises an imaging section 51 
composed of a CCD or the like, a lens 52 that forms a 
captured image on the imaging section 51, a filter 
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turret 53 provided with a plurality of filters 54 
having predetermined characteristics, and a filter 
control section 55 that controls the filter turret 53 
in accordance with a control signal from the personal 
5 computer 21, shown in FIG. 2, to place the desired 

filter 54 between the imaging section 51 and the 
lens 52. 

Three of the plurality of filters 54 provided 
in the filter turret 53, are for red (R) , green (G) , 

10 and blue (B) , which are the basic colors (primary 

colors) of color images projected by the projectors. 
These three filters 54 are used to correct color 
nonunif ormity of offset light. In measuring gamma 
characteristics, R, G, and B components can be 

15 .selectively acquired using the R, G, and B filters, 

respectively. 

If the R, G, and B filters 54 can thus be 
switched, then when a black level image (offset image) 
is projected in which R, G, and B signal levels are all 

20 zero, the R, G, and B components of the offset light 

can be separately acquired. Consequently, by executing 
offset corrections using the R, G, and B data thus 
obtained, it is possible to reduce the color 
nonunif ormity within each projector or between the 

25 projectors (the color nonunif ormity of the offset 

light) . This improves display quality. 

The filter 54 may be a normal color filter or 
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a bandpass filter that allows light of a narrow 
wavelength range to selectively pass through. In the 
example shown in FIG. 4, in addition to the R, G, and B 
filters, two other filters are provided. These two 
5 filters are used for geometric correction and white 

balancing, for example, and need not necessarily be 
provided. 

FIG. 5 is a view schematically showing another 
example of the calibration camera 25, shown in FIG. 2. 

10 In the example shown in FIG. 5, in place of the 

filter turret 53 shown in Fig 4, the camera 25 is 
provided with a tunable filter 56 that can electrically 
change the wavelength range of transmitted light in 
accordance with a control signal from the personal 

15 computer 21, shown in FIG. 2. The tunable filter 56 

may be, for example, a liquid crystal tunable filter. 
The use of the tunable filter 56 eliminates the need 
for the plurality of filters 54 such as those shown in 
FIG. 4. Consequently, the size of the camera 25 can be 

20 reduced. 

FIG. 6 is a graph showing the spectrum character- 
istics of the projectors and filters. The abscissa 
indicates wavelength, while the ordinate indicates 
intensity . 

25 As shown in FIG. 6, the characteristics of the R, 

G, and B filters are set to correspond to the 
characteristics of the R, G, and B projectors, 



respectively. Furthermore, the characteristics of the 
R, G, and B filters are set so that their wavelength 
ranges do not overlap one another. Moreover, the 
characteristics of the R, G, and B filters are set so 
as not to contain any wavelength rages in which the 
characteristics of the R, G, and B projectors overlap 
one another. By using filters having such 
characteristics, it is possible to accurately acquire 
the R, G, and B components of the offset light. 

In view of the S/N ratio of a signal to be 
measured, each filter preferably has such a character- 
istic as contains the emission line spectrum of a lamp 
provided in the corresponding projector. Furthermore, 
each filter preferably has such a characteristic as 
covers the wavelength range of the corresponding 
projector as wide as possible. 

Ideally, the R filter blocks light of wavelength 
650 nm or more as shown in FIG. 6. However, many R 
filters allow light of wavelength 650 nm or more to 
pass through as shown in FIG. 10. In this case, 
projector light of wavelength 650 nm or more cannot be 
blocked, so that the R component of offset light may 
not be accurately acquired. This may reduce correction 
accuracy. In this case, it is desirable to provide 
another filter having such a characteristic as the one 
shown in FIG. 10. For example, as shown in FIG. 11, 
a structure may be employed in which a filter 60 
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blocking light of wavelength 650 nm or more can be set 
between the imaging section 51 and the filter turret 
53. This structure enables the R component of offset 
light to be accurately acquired, thus preventing the 
5 correction accuracy from being degraded. The filter 60 

has only to be able to block projector light of 
wavelength 650 nm or more and need not block all the 
light having a wavelength range of 650 nm or more. 
For example, the filter 60 has only to be able to block 

10 light of wavelength 650 to 780 nm. 

FIG. 7 is a graph showing a luminance distribution 
obtained when an offset image in which the levels of R, 
G, and B signals input to the projectors are all 
zero is captured using the R, G, and B filters. The 

15 abscissa indicates the horizontal coordinate of . 

an image projected by each projector. The ordinate 
indicates luminance. In the example shown in FIG. 7, 
for simplification of description, two (projectors X 
and Y) of the three projectors 23a, 23b, and 23c, 

20 shown in FIG. 2, are shown. As shown in FIG. 7, the 

luminance ration of R, G and B varies within each 
projector and between the projectors. This results in 
the color nonunif ormity of offset light. 

The present embodiment suppresses the color 

25 nonunif ormity of offset light resulting from a 

difference in the luminance ratio of R, G and B as 
shown in FIG. 8. Specifically, the target offset 



luminance levels of R, G, and B are each adjusted so as 
to equal the maximum luminance level in the correspond- 
ing luminance distribution. Thus, the luminance 
ratio of R, G and B is equal all over the area of 
projection. This enables the suppression of the color 
nonunif ormity of offset light within each projector and 
between the projectors. 

Now, with reference to the flow chart shown in 
FIG. 9, description will be given of operations of 
the multipro j ection system according to the present 
embodiment. 

First, the filter R is set in the image capturing 
section (camera) 14 in FIG. 1 (SI). Subsequently, the 
measurement level i (the 0-th level to the 255-th 
level) of an input signal is set (S2) . Subsequently, 
the calibration pattern generating section 13 is used 
to set a red color patch R (i) . The image display 
section (projectors) 12 is then used to project a all- 
red image on the screen (S3) . Moreover, the image 
capturing section 14 is used to capture. the R color 
patch projected on the screen. Image data on the 
captured image is stored to a file (S4). Steps S2 to 
S4 are repeated with the measurement level i 
sequentially increased (S5) . Thus, the gamma 
characteristic distribution of R is obtained. 

Steps S3 and S4 may be repeatedly executed while 
incrementing the measurement level of the input signal 
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by one from the 0-th level to the 255-th level. 
However, the measurement level may be increased in 
an arbitrary manner; the measurement may start with the 
0-th level and may then be carried out at the 15-th 
5 level, then at the 31-st level, . . . However, the 

measurement must be carried at the minimum level (0-th 
level) and the maximum level (255-th level) . 

Then, filter G is set in the image capturing 
section. 14 (S6) . Then, as in the case with steps S2 to 

10 S5, steps S7 to S10 are executed for G to obtain the 

gamma characteristic distribution of G. 

Then, filter B is set in the image capturing 
section 14 (Sll) . Then, as in the case with steps S2 
to S5, steps S12 to S15 are executed for B ■ to obtain 

15 the gamma characteristic distribution of B. 

Then, on the basis of data obtained by the 
measurement of the 0-th level of the input signal, the 
image correction data calculating section 15 is used to 
calculate offset levels such as those shown in FIG. 7, 

20 for each of the R, G, and B colors and for each pixel 

(S16) . Subsequently, on the basis of the calculated 
offset levels, target offset levels are set as 
described in FIG. 8 (S17) . 

Then, a projector number j (j=0 to P, correspond- 

25 ing to the number of projectors) is set (S18) . 

Subsequently, the image correction data calculating 
section 15 is used to calculate offset correction data 
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for the projector j and for each of the R, G, and B 
colors. For example, offset correction data is 
calculated which corresponds to the difference between 
the offset level of each pixel obtained in step S16 and 
5 the target offset level obtained in step S17 (S19) . 

Moreover, the offset correction data on the projector j 
is stored to the image converting section (S20) . 
Steps S18 to S20 are sequentially repeated for each 
projector j (j=0 to P) . 

10 In this manner, the gamma characteristic 

distribution of R, G, and B as well as the offset 
correction data on R, G, and B are obtained as 
described above. 

Thus, in the present embodiment, the image 

15 capturing section (camera) is provided with R, G, . and B 

filters corresponding to R, G, and B of the image 
display section (projectors) . These filters are 
sequentially switched to obtain offset light data for 
each of R, G, and B. The acquired offset light data is 

20 then used to calculate offset correction data. It is 

thus possible to reduce the color nonunif ormi ty (the 
color nonuniformity of offset light) within each 
projector and between the projectors. 

In the above embodiment, as shown in FIG. 8, 

25 the target offset luminance levels of R, G, and B are 

adjusted so as to equal the maximum luminance level in 
R, G, and B luminance distribution. Accordingly, a 



black image may appear bright. In such a case, after 
calibration, ND filters having the same transmi ttance 
may be installed in the projectors. By thus installing 
the ND filters, the luminance of an image can be 
reduced to display a clear black. On the other hand, 
by installing the ND filters after calibration, it is 
possible to prevent the capturing from requiring too 
long a time during calibration. 

According to the embodiment of the present 
invention, a mul t ipro j ection system can be provided 
which can reduce the color nonuni f ormity within each 
projector or between projectors and which provides 
a high display quality. 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, 
the invention in its broader aspects is not limited to 
the specific details and representative embodiments 
shown and described herein. Accordingly, various 
modifications may be made without departing from the 
spirit or scope of the general inventive concept as 
defined by the appended claims and their equivalents. 



